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ABSTRACT , * - , ^ * 

Article 77, Section 28a, of the Annotated Code of the 
Laws of Mai^yland, cprnmo^nly called the Maryland Educational 
Accountability Prograio-' (MAAP),' was passed in 1972 by the Maryland 
General Assembly. This act should insure when properly implemented,; 
that educational programs: (1) lead to the attainment of established 
educational objectives, (2) pro.vide information for accurate analysis 
of costs of instructional programs, and (3) provide information' for 
the analysis of the^ differential effectiveness of instructional - 
programs. Compliance with the MAAP 'includ,es the establishment of' 
goals and objectives in, but not limited to^. Blading, writing, and. 
mathematics at all levels — state, school system, and individual 
school. The act requires a school by school , Purvey of the current, 
status of student achievement in relationship to established 
pbjectives, the developifetit of programs by each school £6r meeting 
its own n^eds, an^l the establishment of evaluation procedures for 
det^ermining the ef f ectiven^jss of these programs. MAAP stipulate? that 
a yearly report be submitted by the State Super in^tendejit of Schools ♦ 
to the Governor and State legislature. This Handbook was developed to 
help ^paure that MAAP responsibilities at all levels are understood 
clearly and carried out effectively. (Author/BJG) 
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PRE^CE 

These guideline^ are to used by all Maryland public schools 'in 
implementing the Assessment Component of the Maryland Educational Account- 
ability Prb^m. They. were developed 'for the Maryland State Department 
.of Education on a contractual ba'sis b,v Research Triangle Institut'e (RTI) 
of North -Carolina. RTI worked closely with a review panel of S^te and 
local testing program administrators and accountability coordinators: 

Robert J. Eckert, Director of-InstVuctional Services 

Kent County Public Schools 
^Donald Hastings, Assistant Superintendent of Instruction 

Worcester County Public Schools • ' * . 

Johi;i J. Hull Director of Professional Services 

t Washington County Public Schools 

Roberta Keiter, Assistant Director of Test Administration 

Montgomery County Public Schools • 
Heritian Lowenthal, Division of Program and Pupil Appraisal 

Baltimore City Public Schools 
John H. McCauley, Supervisor of Testing 

Baltimore County Public Schools 
Ru£h Reid, Supervisor of Instruction ' : 

Calvert County Public Schools 
Mohammad A. A. Shami, Consultant in' Research 

Maryland State Department of Education 



The product in draft form was further reviewed by, all the local coordi- 
nators for accountability and the State Advisory Committee on Accountability 
whose names appear on the following page. In^addition, the guidelines were 
presented for approval by the Maryland State Board of Education before 
the final printing. . • 

The contribi^tions made by these groups are sincerely appreciated. 
This handbook is intended to assure the required uniformity in test a,dmini<s- 
tration procedures security of test rtiaterials, and other matters with the 
aim of estabdishing an accountability assessment system which is fair to 
students, staff, schools, and school systems* 



Sincerely yours. 




/James A. Sensefnbaugh. 

State Superintendent t)f, Schools 
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^ . . * * Chapter 1 ' , . * ' 

Introduction to the Maryland Accoiintablllty Asses sment Program 

- -5 ' . 1 ^ — a . — 

'\ . r , 

A. ' Purpose < ' ^ 

• n • • ' . 

,^ The purpose of this chapter Is to desctlb^ the background and 

rationale for the Maryland'*;Accountablllty*' Assessment Program (MAAP) 
and to orient the users of the Handbook to the primary goals which 
JIAAP Is designed ^to, aqhleve. ^ The fundamental Importance of MAAP to 
^e state's overall responsibility for educational accountability' 
should be clear tcythe user after reading this chapter. The legaj. 
and administrative mandates and. procedures' described in this chapter 
form the basis for assigning the specific responsibil;^jAes' in MAAP. ' 
whiclj each system coordinator, each school coordinator^, and eaclj par- 
ticipating^teadher must .assume and discharge. 

This Handbqok was developed to help insure? that MAAP responsl- 
bllltles at all levels are understood clearly and "carried out effec- 
tively* Chapter 1 explains what educational , accountability is and ' 
what it means 'to you'.r-/The information in this chapter is divided, 
into the following sections: (1) the law; (2) definition' of account- 
ability; ,(3) role of the State Board of Education; (4)^role of the . 
State Advisory Council on- Accountability; C5) the accountability 
assessment instruments; (6) the state plan for educational account-- 
ability;^ (7) the accountability i:eport to the Governor and the • 
Legislature; (8) precautions; (9) levels of responsibility in account- 
^ability assessment; and (10) Maryland's future in accountability. ^ 

B. The Law 

At^ this v^itlng, some thirty states hav^ fenacted accountability 
legislation. Virtually all of the temaining' states fiave drafted plans 
for accountability legislation or have Initiated. procedures at the 
state- level whichfwill preqllide the need for legislative *iftandates . 
' During the 1972 session of the Maryland General Assembly, Article 
^ection 28a, of the Annotated 6ode of tlie Laws of Maryland was passed. 



The law has come to be commonly called the "Educatlo'nal Accountability 
Act." - ' . . . . • 

The overall pux;pose of. the act is, of course, to provide for the 
establishment of a program of statewide educational accountability. This 
program should assure that educational programs lead tcf the attainment 
of ' established educationa}. oJ)jectives, provide information for accurate 
analysis of costs of instructional programs, and pifovide information, 
for an analysis of the differencial effectiveness of instructional programs* 

The Maryland Educational Accountability Act imposes sever.al requirement 
in its implementation of statet/ide accountability. These include the 
establishment of goaJ.s and objectives in, but not limited to, reading, 
writing, ^and mathematics at all levels — stat#, school system, and individual 
school. The goals and objectives at the system levdl need to be fn 



conformity with those established at t^e state level, and those esjia^K&ished 

by individual schools need to be in keeping with those of the local ♦ 

system and of the jstate* 

Also Required by x the act is a school by school survey of the current 
• * « 

status of student achievement in 'relation to established objectives, the 
development of programs by. each school, for meeting its own needs, and 
the establishment of evaluation procedures for determining the effectiveness 
W these programs. Regular re-evaluation of programs, goals, "^ft objectives 
i3 likewise a stipulation of the act. 

- * ^ • 

The Maryland Educational Aceountability Act also requires iflfat, 

beginning in January 1975, a yearly* report be submitted by* the State^ 

Superintendent of^ Schools to the Governor and to the state^legislature. ' , 

This report must include, but not necessarily be limited to, the prqgre'ss* 

made by the Maryland St^te Department of Education, by the local sysfeins, 

and by each individual school toward the achievement of their respective 

goals and objective?. ^This re]^ort* should also include recommendations a 

for legislation deemed 'necesfeary to improve the quality of education, in 

Maryland. ' . 
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C . Definition of Accountability - • ^ » , 

• * * ♦ 

\ , Simply ^ated, educational accountability shou-ld be viewed as an 

.attempt to explain tbe»reaalt^ achieved by publii school programs . - 

. Its purpose i-s to promote an und^er standing of t*he relationship between ^ * 

the quality of education -and availalild resources* and, -on ^h6' basis of 

that understanding, to make educational .improvements. , • . ' 

. More, specif icaHy, Marylandls accpuntability.prp^'^f^m can* b'fe'sai«4*T':'.^^ 

to ha^e six ^a^ic characteristics. -.tirSjtyiS its po^i t 'i^v^e^ empj^aM^;-' ' > ■ 

Accountability should determine which programs are* eJfective and which . 

are no.tl. Elimination' or modifcation of the iii^f ectiye^prog-rama and 

wider ' dissemination 'and usage of the*ef fective ones ,wiil^4ead'i*to 

general improvement of educational programs* and opportunities fpr 

Bt^idents; ' \- * ; . ' ^ * ' . . • ^ • - •* 

• * • . « 

Secondly, accountability is more' than a testiri^ prograjn. .,A testiiig 

program can logicaJ.ly be a part of an accountability prografc' but it 

is by no, tie^ms 0ie* whole program, ^^t is important that te»st results 

be interpreted in terms of Ideal objectives moBe than in terms of natiohal 

norms. - ^ • ^ * * ' 

Gradual and deliberate movement . into an accountability syibtem is 

. the third characteristic of the Maryland program. ^Rather than attempting 

to develop & complete and exemplary program qtiicklyv Maryland's goaj. 

is to progi;^ss carefully from the basic elements into a complete program. 

* , . ■ 

T-he fourth characteristic .of the program is of special interest 
o teachers.^ Accountability is no t Nje signed to eliminate teacher tenure. 
Accountability is progrim-oriented and'r^ot focused toward evaluating 
« and weeding out inef f ec*t;Lve te^t:hers. There is, in fact\.much legal 
* precedent, for the invalidity of firing teaci^r^ on the* basis, of student * 
• j*acHievpment^ scores . ^ , ^ ' * . 

• . Next is , the characteristic^that requiijes that! accountability demand 

\ ' ' ' ^ i - 

accounting by all personnel, not just" by teachers. All teachers 'can 

• » • * \ 
certainly achieve most effectively when supplied with adequate and 

appropriate resources, pleasant working conditions, and effective and * 

, supportive school administrators. Accotintab;Llity for providing teachers 

# ' . ' , . b . . ^ . 

. ^ ' \ ^ ^ ' ^ [ 



,vath these resources and supporting service3 and conditions falls upon 
. the people at all levels outside the, classroom. ^ * - 

Lastly, accountability should be <lonc6rned with progress in the 
affective, as well as cognitive, ar^as. De>>elopinent of self-esteem and 
concern 'for others is an important goal in the, eyes of the general public. 
Though it Is at present difficult to. assess behavior in the affective 
domain, workable methods of observing and. measuring these behaviqrs 
^vfillV'^Ven'tualXy. be formulated, and the Maryland Accountability Program 
must 'be ready to incorporate such methods. 

' 'D^ Vv Role- of. the State Bpa rd of Education 

* ■ ' ^ - ' — . • 

In response to the accountability legislation enacted (^y the Maryland 

State Legislature and in accord with the- six characj:eristics fornjulated 

. * ' ' • . .t'^ . ^ 

for the State's Accountability Program, the Marylan^jState Board of. 

* • • • ' ' ^v, X ' '• ' 

, Education deternKined that the initial efforts of ..^cc-ountability should 

concentrate on the basic leawiihg skjLldS'fdf 7 reading, Wr^t^ngv^/and / * 

mathematics; Following the cSpeclEicalrion' of 'uesargd edue^tianif-VK^ 

in each of these three arfeas, an ac^puntability syUt^em should measure' /'"^ , 

student lachievement relatiVe to each gqal and theiv pre^pare ^n analyifei's 

of the achievement results "related to other variables, such" as student 

intelligence anti 'socioeconomic status. - . * 

. ♦ 

In order for these tasks to be* accomplished, the State Board of^ 
Education appointed a Sjfcate Advisory Committee on Accountability, drawing 
its members from a broad^cross-section of the ^tate's 'population\ It ^ 
also designated ^the chairman of this committee. A member of the Maryland 
State Department of tklucation was' assigned full-time to the committee, . 
as its executive secretary, * in order ' to make available'^;" as detai^^. 
acpountability procedures* were .developed, technical services ff om-^the 
State Department of Education to the' cdjranittee and to* the local, school; ./, 
systems. f . ^' * ' " " 

The ^Advisory Committee was directed to report to the State. Superintendent 

of-SchoqJ^, and he, in turn, was to report his recommendations to the 1 

State.;Board of. Education^ The responsibilities of the Advisory Committee^ 

included the recommendation of appropriate goal statements for eac.h of . 

r 
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the three baS'iti '.learning skill areas. Also, the commit^tee prepared / -^'^ 
guidelines /,desi^ned to assist 'iDiiai school systemsM-inJiC^0iX.ecting;..p.Up'i^ ' ^ . ■ 
achievement data in the three s^^ill areas. These gu^'d^ines.^cbnst^tj^te 
the content cflE. the remaining chapters of this jrfandbookr Xechn^cal >^ " 
assistance was jn^de ayiiiable. f ircim the executive ^cr^tai^y. -an^. 9^^!^^^ . ' 
MSDE staff as needed tL implement"^ these* gtlidelines.;- y /V'^^ 

E. Role the Statfe ^Advisory Council/oii Accountability \ " 

In June of 1973/ the State AdN/isory Coai^cUi re commend acf to'tfie State 
Board of Ed,^cation certain statewide instructional ^oals/ Alsb.''ihoIu^€d. 

^ . ' ' ^ *V ' '/ ' ''V '' 

in theix statement to the, Board were the recommendatioivs tfiat-the account- \ 
ability program, use locally ba^4d- asaesspfent which to,<i^^^^^ 

to which a scl^ol is sucfces^sEul in meeting 'its own'feo'al^J ih^tra-.-stAtev/ide ' 
testing and reporting program be. developed hy MSDE to/ml^agureVtlie" af 
ment of statewide goals, and that ^iie Iowa ^Test pf. Basic 

al st^te^wide testing ^pirogra,ml\' , iV '-v'-'*^ .'-CvV- "; 
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as a part of the initial 



F. ^ Accountability Asse^^snfent lnstrument^ ^'\\\VNr . . '\ < 'y ' ^^'^ 

The Local Coordir^atpV^, ' the'' A<ivi^6-|;y^;^i^^ tlfe^ State Board 

^ of Educaftion agreed irlxat> all fiygt;§ms wo'ul$^^a<toiniisreX*tl/e iWa Tesf^ of : 
Basic Skills (1971/eAition/.Fo^ ^^^^^^ - 
^x^;Cl971 -editioft,-. FQrm*i)'r>two te^t4:i<f-eV,^iot^l^ the same ' ^. / ^^^^^M. 

^ • Cjb^'pajii^'ana/ndrmM ^nl lthe S;^m^ pQpalatlon;.j.* ifiid^y -se^^l M^rxland st^Hopl \ ; - ' ' '. . 



^ ^^sy$;t:^s(w^ xj)X g4in|;r the lovja test- oi ;Wsip[5ki4^ ^'ait the 

>/' >'*'^time the! iriitr^me^ts were ^selecte^'. :( r '* ' ' ■'••^•f>iO' \ 
A.i]rfajdr ,.ireg(so,n for selecting jthf?,iITB§ 'i&'.;tha^t. t;hls.rtest^s favoraW 



- . . . /A^.i^jdr .^regtsop for selecjting jth|f,iITB§ jj.&.;tha^t. t;hls.rtest^^favc 

' '^ 'Z/*^'''^ '"^'^^C/^ 'reviewed inf .BuY(^;5^ ^/ental MeaburjemeaV YMiliook ^a'iid is hJyghly rajted. ^ 
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Dr Implementation 



^*of • Accountability • 

. - P (^k 



Act 



The plan for implementing the stat:^^«'ab'cou^feabiIity,^,pxi?gram'inclu^ 
,a schedule^ of . deadlines' for complati|:^g..;the;sev/e^ establishing 

goals^ and Objectives. The--first de,$^il ii^e. was /August? i^;1973.', by . 
, tim^. the Maryland S.tate ^oard 6f ^6^&at'ion iaouXi and. disseminated 

the Jioard" statewide goai^ in^iadingv' writing < anSd^ mVthepa^£-ics> s'^'Other* 
scheduled deadlines were Decemoer* 1, ^197^ » for deiyeioplng and disseminating 

a catalogue of goals arid objectives (l>y the hiarVJand Stat©^ Department of 

. V e 

Educatioii) .and June 1-, 1974, for tlie establishmebt' and submission of 

^ s^ohool system goals to the^ St^fe CoQrdin^tol: 9:^, Apeountabil'ity for review 
\ ' . - , ' - , ^ .''-'/ ^ '..'c'S 

, by^!:he appropriate State Goal^. Commit-tee.* ^ y \< 

. '"^ . , The State, implementH'ti.on^,lati by September 1, 

school sys-tem go9Cs;Jur6iil^ be* revie\^e that jby Apf 11. 1, 19.75,,^ 

each school would hav^/je^tablished, its own cTbjectives, .consistent with 



1. / 



it5^ unique i^eeds and in ^keeping; with the^school, system goals. Finally, 
^September 1, 1975, was desi^ria^ed as, the deadlii^e for school ^sterns to 

- ervaluate the objectives submitted bj in( i vidua! schools afid to submit ^ 
a ngjrratiye-repprt to jflft^ Maryland Stat(t Department of Education on the 

- establishment -6't/schooi;-dbjectiives. ^ ' • 

The State}^^ xinprementatiOn plan reauired the establishment of*a,,^:^m- 
'•^^prehensive ami uiii^Qrm statewide testing program- The plan also called 

f or ^the -Establishment, of procedures for 
. .tommuaityi ;drid ^chool chai/act eristics 
re^iied -.the^establishment of .procedunds by which school systems, would 
repbrt test results' and iTifo;rmati>on on 
:-Stat^';Departmen^t of Educatioa^ 
" 'The State plan for implfementatiort 



'-^^l^ghe- ITBS anii CAT would be? given ti 



collecting data on student, home. 
Finally, the implementation plan 
by which school systems, would 
other variables to the Maryland 



of th^ Accountability Act speqified 
all pupils in grades ^ 5, 
and 9^^ starting-'ln the Spring of , ^ore specif ically, the plan 

designated .the' dates March. 1 to 31 ITJ&S and CAT test^. in grades 7 



'ai^d^9 ^nd the period frp«r April 15 to 



an 



May^^45 for T*BS and CAT testing 



Ln grades 3^ and 5.. /To insure that thp^t tes¥S were given under uniform 
conditions and that results were reported systemati-dally and consistently, 
explicit descriptions of responsibilities 'at the different levels were 
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developed* '^ese descriptions and relatedje^ccountat^ility ^procedures 
appear in Chapters 2 through S' of thi^ Handbook. On\ or before November 1, 
1974, according Vo the accountability implementation plan, ^the Maryland 
State Depfprtment of Education would have completed the first summary 
analyst? of all data collected up to that time,.^ 

m|jx)r assumption underlying Maryland's accountability legislation 
iX that the analysis and interpretation of relevant test data and £>ther . , 
information leads to meaningful changes and modifications in ihstructional 
programs. However, it is not suf^^lcient to just assume that the schools' 
instructional programs become more effective and efficient because the . 
State has an accountability pf'pgram. In keeping with ihe Accountability ^ 
Act, evaluation programs must be, developed to determine the effect that 
Modification's of the instructional programs have upon goal attainment. 
The. MSDE is encouraged to assist local school systems and schools in this 
evaluation task by sponsorirjg pilot evaluation projects in selected 
school systems. **• 

Adequate evaluation of instructional programs requires the use of 
more than just norxn-ref erenced tests. Crl'terion-ref erenced^ tests in 
reading, writing and mathematics must be developed and adapted for use ^ 
'in Maryland's public schools. * The State's accpuntability program must 
"be extended to other subject matter areas and to domain^ other than the 
cognitive, one. ■ (There is .also a need to develop effective procedure^ for 
establishing the cost of various instructional- programs. 

H» Handicapped Children, and the Accountability Assessment Program N 
^ ^.There are three sources 'of concern which pertain to Handicapped 
Children and t;he Accouatability Assessment Program: 

1." ValidAty ■ y \ ' V. ^ 

Jhe instruments to be used in the testing program were not normt 
on some children in some special education programs and, therefore, 
would not be valid* for them. However, a valid assessment of Marylan 
educational situation should include sjpme' special, students as^ part 
\ of the total ^educational .need. 



2* Comparability ' ^ ^ 

• If different school systems have special students with varying 
definitions of ''^speci^l, they w:^J.l-' exclude students from the ' * 
, assessment p^ogram^ according to ripcomparab.le criteria". Therefore, 
comparability of the: assessment results would be questionable, 
3. Humanitarian ^ Birns 

We do not want to tes,t''a child to whom the examination process 
is seriously distressing nor, on the other hand, to exclude, and 
thereby possibly to 'humiliate, a child who will not puffer from the 
testing experience*.. ..^ , ^ 

Therefore, the program was explored by a subcommittee of local 
directors of special education. Their recommendation', wh\ch follows, 
was accepted by the State Advisory Council on Accountability and approved 
by tl^e State Board of Education: ' ' v - • 

X)nly certain children included in the third quarterly Data 
System for the' Handicapped (DSH) will be considered as .ha'ndi- 
bapped for testing and be excluded 'for the Accountability' 
. assessment purposes,, * * - \ , 

2. The •following categories of handicapped children reported in' 

the D^H or eligible for inclusion l^'/the DSH will not be included 
) in the Accountaljijity Assessment Program: " 

a. Mentally Retarded (trainable '.ati|:'e^u.cable) . 

b, Deap (profound disability — 9'l'-db ^plus) . 
'C^ Blind and partially sighted." \- 

d'. Physically Handicapped who cannot manipulate a pencil, 
. e. Multiple handicapped. - 
' • f. Emotionally disturbed who' are enjcblled^'ln a public school 
e^ces^ cb^t program, ' ^ 

Children ^ho qualify -for the third quarterly report' of the 
DSH [tut -for an admlnistratiye rea^son fail to, be reported and 
^ who. fall into ^categories lle'ted aboVe ate not to be included' 



in the Maryi^fend -Accountability Assessment Program. It is under-' 
^stc^d and assumed '"'that 'such 'exclu^|ed' children will appear^ in 
, the Subsequent DSH* report. - * • ' n 



All other handicapped children •repoj;ied in the third quarterly^ 
report of the. DSH will be tested and the^r scores will be^ 
reported, ' . ^ ? • * 

3* Each local school systfem will report the* numbers of children^^ 

by *handicap categories who ^ve been excluded from the Account- 
ability Assessment Program, 



!• The "Accountability Report" to the Governor and the Legislature 

There is widespread, and justifiable concern for the manrfer in which ^ 
data from the Maryland Accountability Assessment Program will app'ear in^" 
the Accountability Report to the Governor and the Legislature, The method 
cjf reporting information is crucial to the whol& issue of accountability, 

"At present, plans include the return of the summarized data to the 
local systems for their review so that the local ^admiijistrations may 
provid^their ovM individual narratives for the state report. In preparing 
narratives for their data summaries, local, administrations may wish to 
include descriptions of: ° 

.1, Goal setting activities at the sc^hoo^ system and "i5idividual p 
school levels, , * - 

2, - School system goals and goals for "typical" elementary and 

"typical" secondary ^schools, , m 

3, The result's of the use of State a*$|essment iinst^uments (needs 
' *» revealed, appropriateness for lo/ral population, ,,.), 

^ 4) ' Progress of schools ftoward system and/or school goals not 
covered by State assessment instruments, ' 
^ 5, Program modification activitntes during the reporting ,year- 

and plans for further modification, , . * 

6, Unmet needs for resources to permit improvement of programs 
and services, ' * - c 

J. Precautions * • . * - ' / 

' — ' — ' . » " _ ^ 

Uniform guidelines in test\administration have been prepared and^must. 
^be carefully observed acroXs the state by all school systems. This Handbook 



i-s intended to assume the*required uniformity in test administration procedures, 

security of test materials,' confidentiality of 'individual student* test 

scores, and other mattery, with the aim of/establishing^ and continuing an 

accountability assessment system that is fair to each student, teacher, 

school, and school system., A^dherence to standard - procedures will enable 

V ^ ' • • 

U6 to carry out .our respective responsibilities in a highly professional 

♦ * .* ' 

and ethical fashion. It is of extreme importance to keep these first 

slleps in Maryland's accountability prcfgram fr^e of criticism resulting 
from irregular activities brought about by misunderstanding or naivete, * . 

Several d^^^rectives are given with ^this goal of uniformity and fairness 
in view. - First, ITBS test items should be used exclusively for account- 
a-bility testing activitieS'^^rid absolutely no items from any form or edition 
of the test should be used as a part of 'the instructional program. ,Also, . 
' it has* been dec ided^ that onl^ th^e * specif ied' editions, the ITBS, 1971, , and 
the CAT, 1971, are to be used in .accountabil ity assessment testing and 
on the dates specified in Section G, and that these and all other editions 
\ . of bol!h tests are not to be liseS in any other testing program in the 

schools. In addition, no items ifrom' either test should be used in teachei^- 
Staff workshops, as knowledge of the iteii^s is bound, even unconsciously, 

* * to. influence instruction, ^ 

V K. Responsibility, for Ciri^ing Out the Accountability Assessment Program 
- * t at the State, Local System, \School Building, and Classroom Levels' 

To ''carry out the Maryland Accountability Assessment Program (MAAP) , 

responsibility rests with ail levels of the prof^essional education .community . 

It is necessary that teachets, supervisors, and administrators be cognizant 

of , the responsibilities at jeach level so that expectations are clear to 
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all participating personnel,* • « " ^ 

Responsibilities at the State level include overall planning and- 
coordinating of MAAP; providing support and assistance to school systems 
in carrying out the statewide assessment*; statewide^ collection, analysis, 
and reporting of assessment data; providing the legislature with a; report 
based upon MAAP* results; implementing accountability legislation; developing 
a structure for receipt, Storage, and security of MAAP data; and provicfing 
s/?-hool systems with crit-er^a f or identifying pupils to be excluded frdri the 
MAAP. ' ^ • \ 

■ , , " : ■ ■ ' 



The'responsibilitieis Assigned at*the school system level are discussed 
in Chaptef 3yof, the Handbook; Chapter A outlines the responsibilities at 
the schoolT^uilding level; ^nd the'tespdnsibilities at the., classroom level 
are spelled out in Chapter 5. , * " ' ^ 

L. Maryland's Future in Accountability 

It is appropriate to ask, at this writing: What is required of us 
for the future program of accountability in the state? What, needs to 
be achi%s^ed beyond the first accountability report to the Governor and the 
Legi slature? « . 

Accountability can be said to ex is^* when the following conditions 
have been met: (1) the state goals of education refj.ect the educationa^l 
needs *and interest's of the population; ('2) minimum student achievement 
expectations have been developed in each goal area; (3) current student 
status, recent progress, and needed improvement in each goal-are^ are , * , 
matters of public record and specific objectives for improving* the current 
status have been adopted; (4) programs to achieve specific objectives » 
have been implemented; and; finally, (5)^ the c'ost of programs, i.^., the 
cost of achieving goals and. objectives, is a matter of public record. 

It is necessary, therefore, to* plan a course of action in keeping with 
these conditions, that could be cooperatively developed with the Loc^l 
"Coordinators for Accountability and the State Advisory Council for Account- 
ability. Such an implementation plan should include a r^ticinale for I 
accountability and an assignment of functions to key levels' of the public 
education system in Maryland to assure that appropriate data are collected 
•and disseminated to those political Jurisdictions expected to act and 
follow-up on that information. • ' 

T,he rationale for accountability and assignment of functions should 
maintain, ^nd not alter, the model system of public education establislied - 
in Maryland in past years. For many years $ Maryland has enjoyed a healthy 
balance of state and local responsibility for education. Local initiative, 
along with good financial equilization aid, has been fruitful for public- 
education in Maryland. This ^tbalance between state and local responsibility 
should not be destroyed but rather^ recognized' and fostered through' 
interpretation of- the accountability legislatipn. 
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State resJ)onsibility will need- to 'focus on objectjLve.s pertaining 
to minimum skills specified in the state law, and local school .'systems 
should be encouraged to establish a comi^ehenslve set -of objectives and—" • 
evaluation procedures patterned to local needs, and local perceptions of 
public education. The firsC^half 9f 1974 will be partially d^oteci to 
involving the requisit constituencies ln*j:he drafting of a^jflve-year ^ ^ 
plan based on this described pljllosophy. ^ - - \ 
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Chapter 2 y 
Orientation to Testing 



A,* General 



This chapter provides a general introduction- to four important con- 
siderations for the test administration phase of the Maryland Accountability 
Assessment Program ^lAAP) : (1) preparation for testing: (2) cortditions 
for test administration; (3) potential pitfalls^ and (4) school system, 

is: 

building, and classroom level MAAP responsibilities* 'Each ^ these ' 
considerations is^^^^treated in separate sections below, 

B, Preparation^for Testiilg • 
1* Teacher Preparat^n 

y The qualifications, training, orientation, and preparation of 

the person administering the tests are all very important. Of equal 

importance is the test administrator's sense of responsibility for 

assuring the reliability of MAAP test results. Advance planning, 

training, and ori^tatioi\ are principal responsibilities of Sfehool 

System and Schpol Building MAAP Coordinators, No amount of assistance ' 

from School System and School Building Coordinators' in orientation, 

'^■materials distribution, and supervision, however, can replace' the 

. preparations the teacher (tester) must make. 

Proper preparation for testing on the part of the teacher requirel 

active participation in training and/or MAAP orientation sessions,- 

^^.Qgj^ul study of this Handbook and the test manuals, rehearsal of, 

» • , ♦ 

directions and instructions for test administjration-prior to the 

actual ^testing, systematic-checking of materials received, close 

attention to test administration, sensitivity to pupil motivation 

and to the proper atmosphere for testing, maintaining test security; 

and familiarity with and adherence t6 MAAP guidelines, 

"2^ Student Preparation ' 

In a real sense, the teacher, by being well-prepared, confident, 

and comfortable in the testing situation can, by example, do much to 



13 - 

'.23 ■ ' ^ 



prepare student^ psychologically for testing. Students may not 
respond to lengthy lectures on the importance of testing, but they 
shouJLd be reassured that these tests provide information so teachers 
can help them team better. Your School MAAP Coordinator will* 
provide for practice testing with all third grade pupils. Practice* 
testing will be very helpful in reducing tesponding errors, minimizing 
anxiety, ^nd in promoting &^propria*te and informed test-rfaking behaviour* 
Practice testing ^(using the Houghton-Mifflin Practice Tests) is to 
be, conducted for all third grades at lea^ five days prior to MAAP 
Testing . All pupils have the right to know^why they ar,e taking 
the tests and what uses will b^ made of the results. 
» The teacher shpuld schedule a brief session a day or two prior 

to MAAP testing duri^ig which the nature and purposes of the testing 
can be presented and discussed. Even though all third grades will 
have had a practice test, this ses^sion should also be conducted for 
£hem. For example, the teacher might say: ^ * , 

"These tests show how much you know about reading, spelling, 
vocabulary, math problems, and numbers." 

"These tests will also tell you something about how you and ' 
your classmates compare with other pu{)ils of the same age in 
these skills •" 

"These tests help me (the teaclier) and the other teachers tp 

know how to help you improve and which skills you may need 

help in 'improving.'" ' * ^ , ^ 

These, or similar statements of purpose should als^ precede ^ 

• the practice testijng session for third graders. . * 

* * * - 

C. Conditions for Test Administration ' 

' Administering the tests under standardized conditions is crucaal 
to th^ ultimate success of MAAP. If proper testing conditions are not 
provided in each classroom across the state, student scores pay be con- . 
taminated by,*^tor^ which are totally unrelated to their actual achieye- 



' z^^to': 
is wh^ 



ment'. This is 
and detailed direc 



pthe Handbook and test manuals set forth such specific 
tions and instructions* In order that pupils have the 
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opportunity to perform at their maximum potential, teachers must adhere 
strictly to standard test admiilistration conditions; all subtests must 
be timed exactly ;> all directions and instructions must be clear and. concise; 
^undue noise, confusion-, and. movement must be eliminated during testing. 



D., Potential'^itfalls -t ^ ' 

^Although proper orientation 'and pref)aration will significantly reduce 

the danger presented by the potential pitfalls described here. School 

. * "« « * 

Building and School System MAAP Coordinators and teachers must be alert 

to the damage these problems do to their test results ♦ ^ 

1* Cheating ' • • 

Talking about cheating with the pupils is less likej.y to ^be |^ 

effective than doing something to prevent its* occurrence* Proper. 

* ,^ seating arrangements (without completely rearranging the classroom) - 

and good supervision by^the test administrator are ptobably the 

most effective deterrents to cheating* 

2* Inaccurate Timing ^ 

Accuracy in ^ming is crucial to maiataining standard testing - f 

\ 

conditions.^ This potential problem may be most easily and simply 
dealt with by having the teacher write down the exact time (to the 
second) as soon as he/she says "Begin.", Next, the te^icher should . ' 
add to that time the number of minutes allowed for the subtest being 
given and record the time that will be shown on the clock or watch 
r when the subtest is to end. Form P-3, found at the end of Chapter 5, 
should te used to recqrd these times for ITBS testing. A quantity 
of this form for recording all beginning and ^stopping times will be 
provided in your test materials. Do not wri^e these times on the 
^ chalkboard . Some; pupils will be made more anxious by being able to 
see the 'time written on the chalkboard. ' Regardless of how tempting 
it may be, no group nor^|iny pupil is to receive more of less time 
than that specified dn*^the test directions. 
3.\ Administering Tests a^ Inappropriate Times 

Beginnitig and stopping times, should be scheduled so testing will 
not continue into a period of time inappropriate f,or testing, such as 
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the lunch period, recess, and the like., - Trying to "squeeze just one ' 
more subtest in before lunch" is very tempting — don't fall for itj 
'4. Cdnfusiog &r Inaccurate Directions 

If Students do rfot clearly urid«stand what they are supposed to . 
do, theii: test data i&ay be invalid and may lead to conclusions about ^ 
^eir abilitifes (knowledge and sHll levels) which fre both incorrect 
and unfair. Once again, carejful preparation prior^to testing ie the 
key to avoiding this pitfall. .Careful advance preparation may include 
teacher- orientation and pupil practice sessions. Test administrators^ 
should practice reading the test directions aloud several times during 
^ pre~t est, rehear sal . i- ' ^ J ' . 

' "^5. Teaching to the Test * ' ..^ ' 

It is important to keep in mind throughout the tfest administration 
that the major purpose of this assessment is to sample pupil behaviors 
and to determin^e their 'level of knowledge and mastery of skills relative 
to those areas measured by the tests. The practical value of MAAf* 
results^ would be greatly reduced if the pupils were demonstrating only 
the memorization of information and the single repetition^ of skills. 
Using MAAP tests or sections of the^e tests for academic instruction 
not only defeats the purpose of MAAP biit shows rather, poor professional 
judgement concerning appropriate curriculum practice's.^;, . 
6. Inappropriate Group Size 

Students "should not be tested in groups larger than 40, arid testing. 
• should be done* in intact groups. MAAP testing is to be done in class- 
rooms. In those situations where open-cjassrooms or similar-sized 
facilities ^ad.8t, arrangements should be made to carry out^ testing 
where a group of not more than 40 will be tested at a time. 

E. System, School, and Classroom LeveJ. MAAP Responsibiltties 

The next three chapters provide explicit descriptions of the MAAP 
responsibilities at the system (Chapter 3), school (Chapter 4), and 
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classroom (Chapter 5) levels. jCopies of forms for reporting that MAAP 
responsibilities at thfes^e various levels have been carried out are 

'^preseilted at the end of each' of the r,espective chapters. 

I ThBs^detaxlj^d nature of th^§e descriptions is specifically designed 
to assist all personnel involved in MAAP tp- clearly understand exactly 
what his/her responsibilities are and to provide a guide for rfeportin^ 
that these responsibilities ha^e been-c-arried out. It i'a only by using 
such a precise* fprmat for MAAP^ that uniform -testing conditions can be 
assured across testing sites on^^a statewide basis. Such' uniformity is ' 
et the very heart of the collection of .valid tesjt results, thus 'insuring 

•that the. comparisons made will be f^ir to all pupils involved. 



Chapter 3 

* System Level MAAP Responsibilities 

A . Gener^l^ . . ^ , * • 

Hie dutiesknd responsibilities of the System MAAP Coordinator,^are 
specified in this cJiaptBr of the Maryland- Handbook on Accountability 
Assessment. After the System Coordinator* has carefully ^read the rest 
of the Handbook, he/she, should "use thi^ ^section. as the guide for carrying 
out and for Reporting the" cofiipletion of his/her responsibilities. - • . 

^f your school system already has a clearly established mechanism 
for carrying but systemwide test^ing and if you are familiar and comfortable 
with that mechanism, it can^be used in .lieu of the MAAP system outlined . ? 
here. Remember,- however, that your system^ s testing program must meet all, 
of the standards, regulations, and time-frames established by MSDE for . * Jl^ 

MAAP. Even though your system s testing plan may. supercede the MAAP " 
guidelines, it must not omit nor fall beloW any of the minimum standards > ^'Ji:-.--^;^':^K^^1 
set for MAAP..- . ^ c ""^v^^?-^" 

. Whether yojir system chooses to use the MAAP guidelines set forth ^ ' '"i^". '''^5? J^'J 
in this Handbook^, or chooses to use its own mechanism, all the blue MAAP "^t'^^i^^^i^ 
forms (doded with a^"B") discussed In this chapter must be completed^ sent, ' t^..^^'^ 



and. rec^ivec} by t||e^dates specified there. These "B'**jEorms have been 

placed .together at^the end .of the chapter for reader convenience. 

The System MAAP Coordinator must insure and verify that he/she has 
;^inade every attempt to orient all Schdol MAAP Coordinators with all 

phases of the testing program. yThe* System Coordinator, has overall 
. responsibility f6r the or gani;?at ion, implementation, orientation, and ^ 
> ^verification of MAAP in hisVher system. The Handbook is designed to 

-serve as the primary resource for these purposes. 

B. Appointment of System MAAP Test Coord jriktor and Altfernate by Superintendent 

Each System Superintendent will appoint on.e person who d^s responsibly 
to the Superintendent for coordinating all system-level MAAP activities. The 



S^pi'yJ^o^ alsio the ^aiue' time appoint an :^ternate System 

cvKT»'#n':.-,^;^^^'j^2v^'_^-^^^. ^^j^^^ the regulat Sy^tenr. Test Coordinator 

:^ai^e unable to. fiiif ill liis assigned 

1 ) r'|j^4^PoAsib'ilities. ^responsibiliti^^ of the - Sys^'em MAAP Coordinator 

\ Of ai;ig' d^scrib.ed in 6hej remainifig^ections of this, iihapter., - 

' ^ The 'appointment/ of the System-MAAF- Coordiaiator and alternate must 

V, ^ ' ^. ' / ' ' ']^'\ ' 

be made by the. Superintendent on or iietore JaniOaty 15 and notification 

of the apppiij^i^ihent made in writing^'^tb >the Statjp^lSuperintendent of Schools ^ 

and receivj^-on or before January -20^/ (U^e Fd.r^i B-l*) 
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^;C^'- ;Fybcurement of/Tests, Eri^ctice .Tests, ^Ansver Sheejtis, and Related 
. ' y. H'> /!E6st Materials , A ' ^ t 

w-^ I ^' y ' ' n --^'^ - ' 

VI Each System MAA? Copfdinator is- responsible^! or procuring a Bufticient 

" ' rnumber of lowa'^Te'sts' af -^Basic Skills (IUBS) and Cognitive Abilities T^st 
-r -^CCAT) manuals, test wioklets, appropriate answer sheets, Ho^^htpn-Miiff i,in 
4)ractice tests (3rd grade only) ,^and _yTESTING— DO NOT DISTURB" sfg^^o^r, ^; 
, testing all pupils in grades 3, 5, 7> and 9, -'^^^ ^^^^^^^/i* 

A sufficient number of all these items and materials must be iri^^^Kef?- -i,^' "^^^v^-T-^ 
* hands of*the System MAAP Test Coprilnatar on or Before February 15. (Use.-.- 
Form B-2.) Even though in .some scljoo;! systems it wfll be necessary for 
schools to share test booklets, the -System MAAP Coordinator is responsible 
r^.; \ ^ for the procurement and distribution of all tests and related materials. , 

/ ' ^ ' ' Assigning Central Staff to tdie Assessment Program as Coordinators^ 

Trainers, and -Supervisor^ ^ x ^ ' 

(t'?^** ' ' ' • ' ' . , • '\ 

UWf • . . ' , 'Each System MAAP Test Coordinator should 'solelyXor together .with 

t^i^V the Sup^rinttodent, dependingi^upc^h the Authority designated to the teat 



4 




him/her in 
program and in 

,^%*trainlng those j^ersons wno will be involved Un. fe^e^pTO^ the achool 

.'buj^34±ng level* It maji be .that 'different perWnsj^-wlll'be' appfdinted to 
' serve . in these diffetetit capacities (coord4.nating,\fer4ining, supervising) 
' ;,or :the^ same- {)erson o^ -^lersbiis ma/ be* selected to se:^e *in all .of tliem, 

' ' * ' ' . ; -y ; . / 

This will depen4 upon wh4t vappear.s to be the most feasible« arrangement in 
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j a pd^ticular sphool system. The .number of assistants should be kept to 
a myimiim since- it is always the System MAAP Coordinator who is responsible 
fovrasfd has, to vouch for the successful .completion of each of the system- 
wld4 activities in the *MAAP testing program, ' "\ 

Appointment of all assistants by the System MAAP Coordinator, subject 

> ,tOvtthe approval of the Superintendent, should be made on Form B-3 not 
laCer^ than January 31, '\, , * ■ 

E. Distribution of Tests, Answer Sheets, and Related Testing Materials 
to School Principars ' - ' ' 

, Eich System MAAP Test Coordinator is respons^le for the delivery to 

• each school principal ot a sufficient number of Iowa Tests of Basic Skills 

* (ITBS) and Cognitive Abilities Test (CAT) manuals, ^^test, booklets, appropriat 
answer sheets, Houghton-Mifflin practice tests (Grade 3 only), and "TESTING- 
DO NOT DISTJjRB" signs for testing all pupils in grades 3, 5, 7, and 9 at ' " 
each * schooi V * 



A "^sufficient number of all of these items and materials must be in 
hands of school princ^ipa 
-of testing";:^ (U^e Form B-4,) 



the, hands of school princ^ipals at least two weeks prior to the beginning 



F. Providing Appropriate Orientation and Training for School MAAP Test ' ' 
p Coordinators and Test Administrators : 

It jls the r^esponsibilitys^of the System MAAP Test Coordinator to 

meet with all School ^^MAAP TeSt^bordinators in his/her system to discuss 

the responsibilities- tratsc^^the School Coordinators will have in MAAP. 

Xhe System Test Coordinator Should schedule the meeting at a time convenient 

to all, or nearly all. School' Coordinators. Mak^-up sessions should be 

scheduled for all School Test" dob^dinator^ until all coordinators .haVe had 

' \ ^ ' - ' * ' - 

the opportunity tsi^ discuss*^ the roles and responsibilities that they will 

have in MAAP. A discussion of ro^es arid responsibilities should make 

- V ' * V. - ' / 

explicitly clear what materials dnd.,Services^T^ill be provided by the 

W - . 

System Test Coordinator and what will be the Responsibilities of the 

\ ' . > 

School Test Coordinator. The orienta*pion session for the School' Test 



Coordinators should be beld on or before February 15* (Use Form B-5 foir^V,:; ^ 
this purpose.) , *^ ^ ' , ' ^ 

The System Test Coordinator should arrange an orientation and trailing 

• * — 

session for all test admini§trators9 and he/she should specifically assign 

this responsibility in writing to each School Test Coordinator* (Use Form 

B-5?lfor this purpose.) " y ' 

G.' Carrying Out a Program of Testing Supervision to Insure that MAAP 
Guidelines are Being. Followed ^ 

Each System MAAP Test Coordinator will be expected to visit: all classes 
Nbe4ng tested 'in a randomly selected school during each day of supervision 
throughout regularly schedtiled. testing*— It:, is recommended that these visits 
be unannounced* During these visits the System MAAP Test Coordinator should 
offer whatever suggestions that he/bhe believes will be helpful, provide 
the School Test Coordinators and tjBst administrators with requested information, 
• and prepare a report on any observations which he/she believes will be useful 
in determining the reliability and/br validity of the test data for the 
sites^ visited* Reports of each visit and significant observations should 
T^e Included on Form B-6 and should be sent to the State Superintendent of 
Schools not later than one week after the last da}^ of regiilarly scheduled 
testing with the CAT*\ . ^ \ y 

The System MAAP .T^st Coordinator may wisji to assign supervision fesponsi- 
bilities *ta th^ School Test Coordinator or to use other staff to assist him 
in this responsibility,; In those situations where supervisory responsibilities 
are, assigned *o others by the System MAAP Test Coordinator, ibh^e latter should 
provide those persons appointed^ to assist him/her with a set of guidelines 
to insure that their observations are systematically made and reported. It 
will be the responsibility of tlie l^stem MAAP Test Coordinator to transmit 
the reports of relevant observation^ to the State Superintendent of Schools* 



— \The testing schedule, in each district 16 the responsibility of the 
System MAAP Test Coptdlnator mid . 9hould be developed within the general 
^ Iguideline dates set forth by MSDE. ' t - . 
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.^JKoseZjjersons p\her than, the System Test Coordinator making these -observat ions 
^ shoul^. be identified, and their observations included as a part of Form B-6 
or attached to it as a separate item. ' ■ 

. , '" ■ • " " • \ ■ 

-Providing Systematic Procedures for ' Collection of Test Results. 4 est 
Booklets, and Related Testing Materials 



The System MAAP Test Coordinator should make arrangements for all ■ 

C 

test results, test manuals, and related testing materials^ to be picked up 
>V.<^:t^^^^ of the schools *in his/her system': These materials should be 
' ->:re^died for pick-up by the School Test Coordinator. A record of the • 
materials picked up should be made by , theTperson receiving the materials, 
at the time that they are received. The form used for this p^jr-pose is 
B-7. This form should be signed by the School Test /Co^dina tor at the ^ 
time of the pick-up,, showing that he. agrees with the receiving agent's 
count and report* of the quanti-ty of each icem being handed over. The 
deadline for collection of these materials is one week. after conclusion 
of regularly scheduled MAAP testing. Separate B-T; Forms will need to 
"^be completed for ITBS and CAT testing. 

' I- Preparing and Transmitting Test Res ults to MSDE 

[ i ! : 

The following. data are to be repprted for, each school in the system 
for gra^s 3, 5, 7, and 9. The data are to be reported, in computer print-- 
out form or on Form B-8 and should^ be received by the Maryland Stat-e 
Department of Education on or before July 1. • 

General Information * ' 

1. School system name and sChpoJ. name. 

2. Number of , students enrolled in grade as of September 30. 

. « 3. Number of students tested on^ each subtest. y «><r'-"^"-- • * 
Information from CAT Nonverbal Subtest W '^ c..^.. ..... 

1. School mean Standard Age Score (SAS> Jby. -grade. ' 

2. . School standard deviatic^ii'of SAS distribution by grade. 



InformatloA from ITBS Subtests: Vocaljulary> R eading ComprehghSlon, 
Spelling. Capitalization, Punctuation, Language Us age, Language Total, 
\ Mathematical Concepts. Mathematical Problems. Mathematic al Total 

1* ^ School mean GE scores by grade. ' . ^H^, 

2. School standard deviation of 6e score distributions by §rade.r>^ 

3. Translation of' grade mean GE subtest ,score3 in No. 1 above. ^ 
under ITBS Information into school percentile tanks, using 
ITBS tables entitled "Norms/Averages, Forms 5/6.1^ 

4/ From grade mean SAS scores in No. 1' above, under CAT Information - 
determine expected grade mean GE scores for 'the following: 
Vocabulary, Reading* Comprehension, Language Total, .and Matl>e- 
V-''- matics Total. 'Use tables, pp. 55-57,^ ITBS manual entitled 
"Percentile Norms for Standard Age Score Levels.'' ,X 
Whether or not Form B-8 is used to transmit the requested information 
to MSDE, it should be examined to clarify the exact nature of the data needed. 
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* MAAP CAI^ENDAR FOR SYSTEM TEST COORDINATOR 



Form No. 



Report Title 



Deadline Date 
for Completion 
and/or Mailing 



To Whom Sent 



Deadline 

Rj^eipt 

Date 



B-1 



B-2 



B-3 



B-4 



B-5 



B-6. 



B-7 



B-8 



Appointment of System' MAAP 
Coordinator and Alternate 



Testing Materials Procurement 
Record 

Record of Staff Assignments 
MAAP 

Testing Materials Distribution 
Record 



Report of Orientation and 
Training for MAAP School 
Coordinators 

Report of Testing Supervision 
Visit 



Testing Materials Collection 
^Lecord 



A Sample Format for School 
Data . 



January 15 



February 15 



January 31 



14 days prior 
to beginning 
of testing 

February 15 



7 days after 
completion of 
ITBS Testing 
and again 7 
days after 
completion of 
CAT Testing 

aZ- days after 
^ Completion of 
p MAAP Testing 

June. 26 



State 

Superintendent 
of Schools 

Hold 



Hold 



Hold 



Hold 



Coordinator 
of 

Measurement 
and ) '^^ 
Evaluation, 
R* E* I • S •> 



Hold 



State 

Superintendent 
of Schools 



January 20 



TEA 



TBA 



TBA 



TBA 



12 days after 
completion of 
ITBS Testing 
and again 12 
days aft6r 
completion of 
CAT Testing 

TBA 



July 1 



4 ) 
i 
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Form B-1 



APPOINTMENT OF SYSTEM MAAP COORDINATOR AND AL^RNi^E 



School System: 



TO: 



(State Superintendent of Schools) 



(Name) 



has been designated i>y ^ 



\ 



the undersigned as System MAAP Test Coordinator. The Alternate System MAAP 
Test Coordinator is 



^(Name) 



^ > 



(Date Mailed) 



(Superiflteni^n^lfef Schools) 



(Date Received) 



(State Superintendent of Schools) 



Deadline date for receipt of notificatiqn of appointment of System MAAP Te^^t 
Coord inatoir^and Alternate by Stat^ Superintendent of Schools^ Janualry ,20*^^ 



Form B-2 



TESTING MATERIALS PROCUREMENT RECORD 



School System: 



f 



confirm that the following tests 

(Name) 

and test-related materials were procured and securely stored in this school 

« •* * 

system on or before February 15 of the present year. ' 



ITEM 



'QUANTITY 



LEVEL(S) 
AND/OR FORMS (S) 



CODE NpS. 
FROM TO 



1. ITBS Manuals 

2. ITBS Booklets 

3. CAT Manuals 

4. CAT Booklets * 

5. ITBS Answer Sheets 

6. CAT Answer Sheets 

7. Practice Tfests 

♦ 

8. Practice Test Ansfwer Sheets 

9. Testing Signs 



Total Number of .Pupils ^o Be Tested: 



' * (System MAAP Test Coordinator) 



Deadline for completion of this form: February 15. This form should be held 
by the System MAAP Test Coor4inator until requested by an official from MDSE. 
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^ Form B-3 

REPORT OF STAFF ASSIGNMENTS IN MAAP 

School System: ' 



, This, is to confirm .that I, the undersigned, have appointed the below 
named members of the central staff td assume the designated s.^stem level 
responsibilities in MAAP. - ^ *\ j 



Name of Central Staff Member 



Type of Responsibiltfcy 
Orientation Coordination Supervision 



(Date) 



(System MAAP Test Coordinator) 



) 



.9 i 



(Superintendent ) 



Deadline for reporting appointments: January 31. This form shoul3 be 
held by the System MAAP Test Coordinator until- requested by an official 
from MSDE. 



f 



I 

PQ 
O 

P4 



o 

O 
H 



PQ 
M 

H 
CO 



O 

M 
H 
CO 



ERLC 



Verification 


1 

1 

Principalis 
Signature 














4 ' 


1^ 

• 


- 




Name 
or 
School' 


< 


• 














\ 




Date of 
Delivery 














• 








pe and Quantity of Materials. Distributed 


Signs— 
"Testing- 
Do Not 
Disturb" 










; 




\ 








Practice 
Tests 
& Ans. 
Sheets 




- 










1 

i 








CAT^ 
Answer 
Sheets 






















CAT • 
Form or 
Level 




• 








r 










CAT Test 
Booklets 

Code 
Numbers 
From- To 


• 








« 












CAT 
Manuals 


• 




















ITBS 
Answer 
Sheets 












/ ^ 

c 


1 










ITBS 
Form or ' 
Level 




1, J 

V * 




4 


/ 






% 








•ITBS -Test 
Booklets 

Code 
Num&ers 
From- To 










1 

. / 


/■ 










; 




ITBS 
Manuals 
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Form B-5 



report. of 6rientati0n and training for maap 
' 'School test coordinators 



I, 



at 



(System MAAP Coordinator) 
(Location of Meeting) 



confirm^' that. aWeting was held. > 

"1: 



on 



(Date) 



and was attended by those persons whose names appear below. I ..further confirm 
that the responsibilities of the School Coordinators were discussed until it 
appeared that they were understood by all in attendance. 



1* 
2. 
3. 
4. 
5- 
6* 



7- 
8- 




^Finally, I confirm that I have assigned the responsibility for training 
the administrators of the tests to each School MAAP Coordinator: Yes No . 



(Date) * 



(System MAAP Coordinator) 



Deadline for holding orientation and training meet;ing: February -15. A 
separate form* should be completed for each meeting held. Completed -forms 
should be kept) by the System MAAP Test Coordinator until requelsted by an' 
official from.MSDE* 



'.I 
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Form B-6 

V , REPORT OF TESTING SUPERVISION VISIT 

■■ '.^ « 

TO:^ State Coordinator of Measurement and Evaluation, R.E.I.S. 

J^M: , School System: 

(System MAAP Test*^ Coordinator) 

This is to report that as System MAAP "fest Coordinator, I visited the ' 
following schools on the desjLgn^ted dates. " 



1. 
2. 
3. 
4. 
5. 
6. 



School * ' • Date 



■ . ^ 



The .MAAy test 'being administered at the time of my visit waSi the 



(Name of MAAP Test being Administered) , ' . 

Tdtal number of classes being tested at grade levels 3, 5, 7 and 9: 

Total number oi teachers with whom you talked: ? , - \ 

Comments: (Be certain. to describe any observations ^which you believe will be 
useful in establishing the relialJility and validity of '.test data 
obtallned frpm the schools you visited.) 



Deadline for, completing and mailing this form: one week after the completion^* 
of ITBS testing and agaiiLpne week after the completion of CAT testing. The 
form should be mailed to the Coordinator .o*f Measurement and Evaluation, R.E.I.S 
by 12 days after the completion of ITBS /testing and* again 12 days aft^er the ^* 
compietipn of 'CAT testing. / ' ' . * ' ^'-^ ' 
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o 



O 



CO 

H 

O 

CO 
H 



'X 



^ Verification 


* 

Signature of 
School MAAP 
Test Coordinator 


/ 




\ 




* 






0 

. *^ 




• 


4 


^ 0 


H 
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3 


J 

w 




1 




1 

o, 

CO 
H 
CO 
'••H 

t4-t 

4i 

•H 

. §■ 

t, 

CO 


Signs — 
"Testing-^ 
Do Not 
Disturb" 


• it 








V 






« 


* 








o 

t\' •CO 

4J CO 'CO 4J 

CO 'O) < 0) 
P4 H CO 


"J 

♦ ^ 
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f 
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/ 
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Form B-8 
A SAMPLE'.FORMAT FOR SCHOOL DATA 



School System Name; 
Grade*: 



School Name: 



Students Enrolled: 



Information about CAT • 



Number of 
Students Jested. 


Mean 
SAS Score 


Standard Devi- 
ation of SAS * 
Distribution 


* 







Information about ITBS 
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1 ' 1 

1 

Area of Test 


^Number 
.Students ' 
-Tested 


Mean 
r GE Score 


Standard 
Deviation 
of GE Dis- 
tribution 


i 

Expected 
GE FroAi 
Mean SAS 


■ Percentile ' 
Rank of 
Mean GE 


Vocabula^ry 






• 






Reading ^ " 

'I 












Spelling. * • V ^ 








. : 




■ \ 

Capitjgtl iza t ion * 














Punctuation 








# . 






Language U^age 














Language Total 














Mathematics 
^ -^Concepts 


\ 








\ ' / 




Mathematics 
^ Problems' 






\ 






Mathematics 
Total 








* *t 


'v'^N Va'v — Vv". 





* Use a separate sheet for each grade*. 
** Blank cells. 



Deadline for receipt of this form by the State Superintendent of ySd 
Ju^Ly 1. . . 



^^^^ ^ 
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The purpose of-'this chapter is to provide a set of uniform instructions 
and guidelines for the administration of {he Iowa Tests of Basic Skills 
^nd the Cognitive Abilities Test in your school. The School Test Coordinator 
uld be thoroughly familiar '^ith -the purposes and rationale of the ^ 
Maryland Accountabilitj^fi^^^esement Program (MAAP) and with thfe role played 
by MAAP personnel at ■ tKe^ot^r levels oiE responsibility (state, system, 
and classroom). For ithife reason, the School MAAP Coordinator is urged 
to read other- chapters of this Handbook. ' 

Your school sys,tem may choose to utilize its own structure for carrying 
out MAAP testing. If so, "you will be informed by your System MAAP Coordinator 
. He/she will provide you Twith the necessary orientation and written guide- 
lines. Whether you are' directed t^o use' your system's plan or the MAAP plan 
contained in this Handbook, you are responsible for insuring and verifying 
that minimum MAAP istandards h'ave b^en met, by your school. This Handbook 
contains those minimum standards and the report forms for verifying your 
...school's adherance to them. All forms refe'tenced in this chapter have been 
placed 'at the end of the chapter for reader convenience. These "Y" coded 
forms should be completed, mailed, and received on or before the specified * 
. deadlines. * ' 



B. Designation of MAAP School Test Coordinator and Alternate by the 
. Principal . . " 

Each school princi^^ will appoint' one person who is responsible to 

the Principal for coordinating all school-level MAAP activities* The !. 

principal should al'sos at the,, same time appoint an alternate School Test 

Coordinator in the event the School Test . Coordinator should become ^ 

incapacitated or otherwise unable to fulfill his assigned responsibilities, 

The^^specif ic responsibilities of the School MAAP Test Coordinator are 

described J.n the remainder of the Yellow Section of this Handbook. 



< ' 
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The^designatioi) of the School MAAP" Test Coordinator must be made 

by the principal on Oi: before January 15; notification of the appo^ntment^ . 

• 

must be made in jfjiting to the School System Administrative Offices 
(Superintendent of Schools) and received on or before January ^0. (Use 
Form Y-1 . ) ' . . . 

C. Handling apd .Storing Tests, Manuals, Ansvef Sheets, and Related 
Test Materials 

1. Receiving Materials 

, Each School MAAP Test - Coordinator is respotisible for receiving, 
checking, storing a sufficient number of ITBS and CAT examiners' a 
manuals, test booklets, answer sheets, and "TESTING— DO NOT DISTURB"! ^ 
signs for testing all pupils in grades 3, 5, 7, and 9. He/she should 
also receive th^ same number of Houghton-Mif flin'practice tests as 
v'there are third grade children to be tested in his/her school. Each 
School Coordinator is to procure the appropriate number- of No. Jl 
pencils for MAAP testing. ^ ^ . 

The School MAAP Coordinator is responsible for checking and 
signing in (vouching for) a sufficient number bf all of these items 
for his/her building. Tests and test-related materials must be in 
the hands of the School MAAP Test Coordinator at least two weeks 
prior to the beginning of MAAP testing. (Use Form Y-20 . ' . 

2. Storing Materials * * , > 
Each School; Coordinator • is tesponsible•^or the proper storage 

and security of all MAAP tests and materials. 'Th^ test's and materials 

are to be stored in sealed cartons* (boxes) after they haye 'been checked 
^for correctness of quantity, level/form, and after the test ^booklets 

have *been checked for proper sequence of code numbers. All test 
^ materials must te, ^stored un^er lock and key within the*'ischool building. 

(Use Form y-2.) ^ ' ' v . ' 

3. Distribution of Materials ^ ' . 

Each School '(Coordinator is responsible for distributing only thev / 
number of tests, manuals, ^answer sheets, and. No. 2 pencils to the / 
teachers (testLrs) ^required for each separate testing and make-up 
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*> session/ The. School Coordinator will have each teacher (tester) 
check his/her materials and sign Form Y-3 for materials received 
immediafely prior to each testing or make-up session* This form 
' should be held by the School Coordinator until the completion of all 
MAAP testing and then mailed' to the System* Cobrdinatbr no later 

* ; than May 20. ^ ' ^ . * '^'^''-^ 
• 4* Coilection of , Materials 

The .School Coordinator is responsible for collecting the tests,^" 
manuals, answer sheets, and "signs after each^ testing sessioja and fQt^% - 
storing and securing the MAAP materials** As the materials are collected 
^ from each teacher (tester), the School Coordinator will use Form Y-3 
to check the matei^ials in* Pay particular attention to the code numbers 
on the test bopklets coHected from ^ach teacher to see th^t they 
ar^ in projper sequence and that the quantity is correct. All test 

• bookie ts.and'^ answer sheets must be collected and checked in the>same 
day on* which they were distributed. ' , i ' ' /^ 

:in ^addition to collecting- the answer ^sheets -.and test booklet^ ' - 

after each ^testing session, it i^, the diity of .th^' School Coordinator 

^ - ' • . " '"^'C ^ - 

to collect Form P~2 from the teacher.^ 'Form P-r2\is presented at thfe 

- ^ ' '. ' . r ' . ^ 

end of Chapter 5. Collection of 'F6rm.Pr2 wiil'ii^ermit the School 

-"^^ --^ \' i . - ' " ■* 

Coordinator to keep a daily ta 11^ of ';^ai'sen tees so. make-up sessions 

can be^g£^opriately scheduled an^*- ef^fdciently^ conducted. To that 

Jend, it is suggested that tlie School Copxdinatprr identify and list 

. the absentees bV name, classroom,- and'ygrade after.each testing session 

SO he/she can pull out thfe proper 'test;,^booklets arid. ^swer , sheets and 

have these materials ready for the\make-*up session. 

' The Summary 'Report of Absentees arid Incomplete' Tests (Form Y-4) 

is to be filled out and submit ted -to' the System MAAp Coordinator 

after the last testing or make-yp session is completed. Form Y~4 

should be mailed to the System MAAP Coordinator one week after 

rconclusion of MAAP testing. ^ • 

5. Packaging Materials / ' • . 

Each School Coordinator' i9 respoilsi^^ packaging the MAAP' 

materials into their original cartons^' 1 T^B-answer sheets should be 



pa.ckagec^ separately by classroom (teachexj then by grade level (e.g,, 
all third grade packages , in "dn^x^^ro^pi .all fifth ,gr^de packages 
Another )^ . ' . .v. ..^-i'^ ^ ' ' - ' « 

.'^fie sure to keep all MAAP mat^ials stored and locked until they * 



ir^^.icked up by or deliv^.re^ to the System MAAP Coordinator. 
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Arranging Testing 'Space, Facilities, and Equipment 
Ea^h -School MAAP Coordinator is responsible for checking to see 
'tjiat proper conditions ar^ met ai\d»-xiiaintained^during the testing period. 
Form Y-5 will be used for "checking and confirming proper testing conditions. 
This ierm is to be mailed, to the System Coordinator one week after the 
completion of MAAP testing'. ,X^^' , , - . 

It is important- ^ ^j:0:^ ^ ^phas£^ that testing is t£ be carried out in ' 
intact classroom ^groups , -'^arge-group testing in^ which several classes 
are brought together jLn a caf'eteria, library, auditorium or the like , ^ 
is hot permitted. Further, ajil testing, timing, and instructing is 
to be done by the teacher (te^terj in each partia?.pati^g classroom. The, 



usei 'of the school -^tergom or PA system is not permissible under MAAP 
giiidelines, ^ ^ ■ 

\ . \ f. Or • ■ ' <■ ■ ■ . ■ 

E. Teacher (Tester) Orientation for Test Administration 

School Coordinators may b^^assigned 'thfe rS^&nsibility of condW>tii>g^ 
a training-orientation session in his/her schp9l taft -least two weeks prior 
to MAAP tes^t administration. However, this trailing "may be provided by 
the System MAAP Test Coordinator. Because this t>r*ogram diffets from 
traditional school-wide testing, no teacher who is scheduled to admin^lster 
MAAP, tests is to be excused from the orientatian session. Further, at 
least one alternate tester for eacH? grady level is to be appointed and 
included in the« orientation, session. The School Coordinator will appoint 
one teacher to collect and transmit to the System MAAP Coordinator all 
P-1 Forms immediately after the MAAP' orientation-training session. (Form 

will serve as the guide for planning, conducting, and reporting the 
Staff Orientation for MAAP Test Administration.)'; Form Y-6 should be 
mailed to the System MAAP 'Coordinator nof later than February 28. 
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<iF. School-Level Test Supervision , ' • '"^ 

Each School MAAP Coord'inator is responsible' for carrying out a ^ ' 
systematic program of sugerfcLsi'oi^ in his/her school.' The School Coordinator 
may be assisted in supervision , activities by systemr-level jandVor* MSDE. 

. personnel, at some point during the MAAP ^testing period;./ The School 
Poordinator .must be available during each, test session tb observe and # 
assi^ teachers if problems should ar^ise. (Form Y-7 will assist the School 

. MAAP Coordinator in plannteg, implementing, a^d Reporting "MAA^ supervision 
activities.) ThJI^s Form should be .niailSd^to' the System MAAP Cpordinatp?:'"'' 
^one week after the completion of alrj MAAP, testing. 
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MAP CALENDAR FOR SCHOOL TEST COORDlMTQRS 



Form 
Number 



Report Title 



Deadline 

Mailing 

Date- 



To Whom Sent 



Deadline - 
Receipt 
Date 



Y-1 



Y-2 



Y-3 



Y-4- 



t-5 



Y-6< 



Y-7 



Designation of School MAAP 
Test'' Coordinator 



Record of Receipt, Storage, 
and Security of MAAP Materials 

Materials Distribution and 
Collection Record 



Summary Report of Absentees 
and Incomplete Tests 



Report of Testing Conditions 



Repprt of MAAP Test 
Administration Orientation 



Report of MAAP Testing 
Supervision ' ^ 



January 15 



Two weeks 
prior to 
MAAP Testing 

May 20 



Seven days 
after the 
conclusion 
of MAAP 
Testing 

(Same as . 
Above) 



February 28 



System MAAP 
Test , 
Coordinator 
c/o " 

Superintendent 

System MAAP --^^ 
Test 

Coordinator 

System MAAP 
Test 

Coordinator 

System MAAP. • 
lest 

Coordinator 



System MAAP 
Te^t 

Coordinator 

System MAAP 
Test 
pordinator 



January 20 



Seven days 
after the 
completion 
of MAAP 
Testing 



System MAAP 
Test 

Coordinator 



^bifuary 26 



May 25', 



12 days after 
completion of 
MAAP Testiiig ' 



^(Same as 
Above) 



March 5 



12. <}ays after 
ctomp'ietion of 
MAAP' Testing 



Form Y-1 

DESIGNATION OF SCHOOL MAAP' TEST COORDINATOR AND ALTERNATE- 



School System: 



TO: 



(System MAAP Test Cqordinator, c/q_Super in pendent.). 



undersigned as School mAAP Test Coordinator foi^' 



h"as been-desi^ated by the 

1^ ' ' 



W (School) 
The alternate School MAAP Test. Coordinator is^-^ 



(Date Mailed) 



(Princ ipal) 



aZB 'Received: 



V 



(Name) 




Signed: 



(Superintendent or System Test Coordinator) 



^ . ' ■ ■■■\ / ■ 

Deadline Date for Receipt of Notification of Appointmeat . of School '-M^^ T^st 
Coordinator: Januar.y 20. This form should be sent to the System MAAP^e.et 
Coordinator, c/o Superintendent. ' 

■i 
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FORM Y-2 



S 



t RECORD OF RECEIPT, STORAGE, Al^p SECURITY OF MAAP MATERIALS 

^School System: i 

School: 

Oa 



(date) 



, I received from 



(title) 



.* (name) v.* . ^ ^ 

the following tests and .test-related matferials:^ 



ITEM 



QUANTITY. 



LEVEL (S) 
AND/OR FORMS (S) 



CODE NOS» 
FROM TO 



1. 
2. 
3. 
4. 
5. 



ITBS Manuals 
ITBS 'Booklets 
CAT ^niials 
CAT Booklets 
ITBS Answer Sheets 

6. CAT Answer Sheets 

7. ' Practice Tests 

8. < Practice test Ans. Sheets 
9> Testing Signs 



Total Number of Pupils to Be Tested: 



On 



(date) 



(S<^hool,MAAP Coordinator) 
I placed the materials listed above in 



(location of MM? materials within the school) • 
lo<^ and key and are stored in sealed cartons** 



These m^terial^ are under. 



(DaC6' Received) 



(School MAAP Coordinator^ 

; 



(System/ MAAP Coordinator) 
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^Deadline Date for Receipt by System MAAP Test Coordinator: February 26. - 
* It is suggested that cartons be resealed with paper sealing "tape, 
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Teachers 
Initials 




















Signs— 
"Testing- 
Do Not 
Disturb 














- 
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Practice 
Tests '& 
Answer 
Sheets 




















CAT 
Answer 
Sheets 
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CAT 
Form or 
Level 
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■h 






CAT Test 
Booklet 4 

Code 
Numbers 
From-fo 
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V 












CAT 
Manuals 










V 

1 
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ITBS' 
Answer 
Sheets 
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ITBS 
Level 




















ITBS Test 
Booklets 
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: Numbers 
From~To 
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0 O 
•H ^ 
U (0 
CO CO 

H W 








1 


in 






CO 


r 



CO 

CO 

H H 

O O 

O O 

o o 

CO CO 



H 

o 
w 

o 

CO 

g 



\ 



ERIC 



o u 

S5 ,0) 
8 % 



0) 

o 

















4 










oients 


















• 






^ o 

o 














/ 
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Signs — 
"Testing- 
Do Not 
Disturb" 










1 

'/ ' 














Practice 
Tests & 
Answer 
Sheets 








t 










• 






CAT - 
Answer 
Sheets 
























CAT 
Form or 
Level 








j 
1 

I 
















CAT Test 
iBooklets 

Code 
Numbers 
From— To 

^ WUI X 








1 
\ 








% 








CAT , 
Manuals 
























ITBS 
Answer 
Sheets 






. 1 
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CO 0) 

H O 
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ITBS Test 
Booklets 
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1 
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CO 
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to 
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Form V-5 
REPORT OF TESTING CONDITIONS . 

School System 



School 



* 1> l: ^ , confirm that the folloVing conditions 

(School MAAP Coordinator) 

were met during each MAAP testing and make-up s^sion at our school- 

. . ^ . . \ 

^ • . 



CONDITION , . CHECK 



Yes No 



1. All testing done in classroom groups? . . . ' 

2^ Pupils with known or suspected vision and/or hearing 
impairments seated near teacher and chalkboard? . . • 



3. Adequate space between seats? . . . . < 

4. Availability of chalkboard? . . . , 

5. Adequate light? . . ^. , 

6. Adequate ventilation? 

7. Comfortable temperature? 

8. Noise within acceptable limits? . . . , 

9. Provision made f oi;>^f t-handed pupils? 

to. 



Sign(s) posted at classroom entrance — "TESTING — 
Da NOT DISTURB"? ; 



11. Availabili^ty of suitable timing device? 

12. Rest breaks provided? ' . ; . 

13. Time limits strictly adhered to? . . . 



14. Beginning and*stopping times for each subtest 
recorded? 1 . . 

15. Was all testing^carried out in intact groups? 



(Date Mailed) . (Date Received) 

- ' " r " f' 

(School mAaP Coordinator) ] (System MAAP Coordinator) 

Deadline for receipt of this form- by the Sysfon MAAE. Coordina^tor : lb d^y£ 
after conclusion of MAAP Testing. ' -^-O 

' '.■ . 54- 



if' 
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FORM Y-6 



REPORT OF ORIENTATION TO MAAP TE5T ADMINISTRATION 

* ' 



School System 2_ 
School 



I, 



J, •confirm that th6 following materials 



(Schopl HAAP Coordinatt)r) 
and activities were included in the Orientation to WAAP Test Administration 
hedd in our schpol on * 



date 



ORIENTATION MATERIALS AND AC^TIVITISS 



1. 
2. 
3. 

4. 

5, 

6. 
'7. 
8. 

io. 

'11. 
1-2. 

13. 

14. 



All staff -ass jTgned to MAAP testing were present?^ ? 

At least one alt^nate for each ^'rade lev^l present? 

One copy of Maryland Handbook on Accountability" Assessm^t 
distributed to each par ti-cipa ting staff member three 
Jpeeks prior ''to Orientation session?) . ^ 

Copy of MAAP Test Schedule distributed to- (pach 
parti<:fpant? \ 

Policy and schedule for make-up testing clearly stated 
, in writing? ' . \ v 



Staff assignments explained and dfscussed?*". 
Rationale for testing program explained? . . 



Clear statement* of conditions under*" which ipupHs may 
be excused frtm .taking test? 



Explanation of importance of adhering to standard 
testing procedures and conditions? 



Information distributed on where, when and from whom 
materials will be obtained? 



Information distributed on packaging procedures and 
return of materials to , whom, where,* and when? . . . 



Explanation ojE 'reasons for close attention to security , 
^j)rocedures for receiving, using, and returning tesu 
m#tlerials'? 1 ; . . . [ 

V * % 

^jEach teacher received one copy of each t^st (ITBS 

and CAT), administrator's manual, and answer 

sheet? • 

*^3ch teacher returned one copy'^of ieach test (ITBS^ 
and CAT), administrator's manual, and an,swer 
sheets?* . . • • 



CHECK 



Yes No 
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MAAP Orientation 



Form Y-6 (Continued) 



V 



Teachers Participating in MAAP Testing 

\ , 

Name 


^< 

Grade^ Level 


Attendance at 
Orientation Meeting 


Pt'P RPn t* 




• 

V 




• 




2. 






f 


3- . - 'j^-< 








4. ' , . ■ 








5. . • 








6. ■ 








7.* - ' ' ■ ■ ■ 




y 




8. 








• * 

9. , . 




/ 




. • \ 








11. . 








12. 









;I confirm that 



has been assigned the responsi 



(Teacher/ s Name) 

bility of collecting and transmitting to the System MAAP Coordinator all*P-l 
Forms completed by teachers in this building immediately following, the MAAP 
orientation-training session. 



(Date Mailed) 



(SchoolfMAAP Coordinatoir) 




(System MAAP Coordinator) 



' Deadline , for receipt 'pf. this form by Syg.tem MAAP Coordinator: March 5. 
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^FORM Y-7 
REPORT .OF MAAP "ifESTING SUPERVISION 

, - S'chool. System 
School ^ 



I, 



(School MAP Coordinator) 

'a 

activities- were carried out in our school between 
and " . - • ' 



, conf irm\tltat the following MAAP supervision 



' (date) 



(date) 



. ' . CHECK 

ACTIVITY^ , . Yes No 

1» Was e^ch ^participating teacher (test administrator-) ^ 
observed by you^on at least one occasion duting^^ch 
MAAP testing session? . 

■ ^ ' ^ ^ . \ 

Were yoju accompanied by system-level pexscmnel at 

any time duting-^your supervision of^teacheifs in your 

school?x\ /\ : \ . \ \ . . -.^f^. . 

3.* Were youvaccompanied by MSDE personnel at ajiy time ^^ ' , 
during yoW sup erv is 1911:^ teachers in wdr school . , 

4» Were all teach^ps^b served by you conducting the 
MAAP t^sti^g-^^cording to specified guidelines 
cLnd ur^der specified conditions? 

If your assistance. was required after a testing session was begun, on any 
occasion, complete the, form below: 

X s \\ 

S, " N- 

Nature of Problem or '.Situation ' Date 



(Date Mailed) 



(Date Received) 



(^4tlool MAAP Coordinator) 



/System MAAP Coordinator) 



De^liniB date for receipt of this fora by 'the System MAAP Coordinator:/ 
l^J^s^^aftfer completion of MAAP Testing* '% 



Chapter 5 

;/ . ; Classroom, Level MAAE. Responsibilities 

■A. G^-.;. . ^ . 

This chaprter/fcTf the/Maryland Handbook on Accountability Assessment 
contains tHe s^peclf'ic guidelines for adioinisCering the tests chosen for 
the; Mary likiid Accountability Asses:sment Program (MAAP) • These guidelines 
will, be cifearer to you if you have read the other chapters of this 

. Hiineftjook/^/ , ' * 

// Ypur major responsibility^' is to insure and verify that all phases 
of testing in your classroom meet MAAP guidelines.. This Handbook is 
yout primary ^E'esource- for carrying out this important responsibility • 

^Jour^Schpol MAAP Coordinator will see that you receive all of the necessary 
tests, answer sheets^and related materials. He/she will inform you 
about ^lAAP orientation and/or training prior to the testing dates • 

Make no assumptions about MAAP testing simply because you have 
administered tests before — even if you have used the ITBS and/or CAT* 
You must prepare yourself in every detail for MAAP testing* If you 
haVe administer^4^tandardized group tests b^ore, you already know 
that the most crucial part of the test administrator's task is to be 
organized, informed, and confident* This "pink", chapter of the Handbook 
Is designed \to assist you in meeting your assigned MAAP responsibilities* , 

B* Becoming Familiar with MAAP Guidelines \ - ' ^, ' » 

, . 'Each classroom teacher who will be administering the ITBS and ^the 
CAT as a part of the MAAP should ^have his/her own- copy of this Handbook* 
It should be read in its entirety, with particular attention being given/ 
to this chapter* The pink report forms that appear at the end of this 
chapter should also be -exipnined quite carefully* ' Only by having read 
and thought about the contents of' this Handbook will you be prepared to 
solicit needed information at the time of your orientation-training 
session* The information contained in this^.Handbook and that presented 



51 •■ 58 



at the orientation- training session will serve as the basis for answering 
many student questions about testing that will arise prior to and during 
MAAP testing, * - ' . ' ' 

Participation in Appropriate Orientation and Training Activities 
Coordinared by the School and/or System MAAP Test Coordinator 

Every teacher who will be involved in MAAP testing, without exception ^ 

should attend an orientation-training session scheduled and conducted by 

either the System or School MAAP Test Coordinator, It is the System Test 

Coordinator's responsibility to either conduct the session or to assign 

this responsibility to the School Test Coordinator^ The teacher will be ' 

presented with the rationale for and policies of MAAP, The teacher should 

note the importance of adh&^ing to standard testing, proce djjge s and'con- 

• ' ' . ' 

ditions. Each teacher should make certain that he/she has received a 
copy* of this Handbook and a copy of the MAAP test schedule at least one 
week prifr to the orientatiofx-training session, A discussion of specific ^ 

responsibilities should lead to a clear understanding on the part of 

/ * * 

teachers as to how, when, and frpm whom test materials will ba^ received 
and how, when, and to whom they:'are to be returned. The discussion should 
also lead to a clear understanding of the conditions under which a student 
may be excused from taking the test. The criteria for excluding untestable 
pupils will be provided Uy MSDE, - 

One of the most important functions of the orientation-training 
session will be to provide insitruction^ and training, relative to the 
actual administration of the ITBS and the GAT< For this aspect of training, 
each teacher should receive one. copy each of\the ITBg^^and CAT administrortor* 
n^anuals and appropriate answer sheets; During this component of ^ the 
orientation-training, teachers sl/ould read over all instructions which 
apply to those su^ests of the ITBS and* CAT that will be administered 
as;a part of the MAAP, All te^cK&iss should haVe the opportunity ^o study 
and become thoroughly familiar \HthVhe applicable" administration instruc- 
tions and procedures, \ - ^ ' 
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Some school systems will have prepared their own manuals far test, 
administration. So long as these manuals do not in any way presjcribe/ 
conditions and procedures which 4eviate from those 'in the regular, V 
administrator's manual, they should be considered to supersede the 
published manual . ^ s ;/ -* . 

The orientation-training session should be scheduled not ipbre tl\aK^ ' 

14 dl^s nor fewer than seven (7) days prior to the first day of' regula^f ly' 

\ ^ ' - ^ ' ^^'v 

^ scheduled testing. ^ ^ ' , . 

A report of the orientation-training session, aiid of^ the activitieg^ 

which took place in it should be made on Form P-1 T^his report should 

"be coraple^ed^, giv^ to the teacher designated by ^the School Building* 

Coordinator to collect them, and mailed to the System MAAP Test Coordinator 

not more than two days following the orientation-training session. 

D. Receiving, Distributing, Collecting, and Maintaining Security (?f 
all Test Booklets, Answer Sheets, and Related Testing Materials 

1. Receiving Materials 

■ - ^ Each teacher should^ receive from the School MAAP Test Coordinator 
enough test booklets, answer sheets; and No. 2 pencils for each 
pupils being tested in his/her ' classroom. The teacher shoifld also 
receive an admWistratar 's test manual and a "TESTING— DO NOT DISTURBV 
sign. After these materials have been received and checked, the 
teacher should sign the School, Test Coordinator's Form 
These materials should be received the day in which they are to be 
used.* They should NEVER be received prior to the date-of the 
s,chedul:ied testing. " ^ ^ . ' . - ^ 

2. Distributing Materials 
Each teacher is'^responsible for distribution to each student 

those materials,- and dnly thpse materials, specified in the adminis- 
tration manual for thfe test being given. NO student should be given 
more or fewer items than called for in the manual, and no exceptions- 
'Should be made. ' • 
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3. Coilectin^,Matei;:lals . >♦ ' ■ '\ ' 

Each teacher is responsible for collecting from each student ' 

those materials u§ed by thQ;^*student for the just comp^leted test* It 

is recommended that students nat be asked to pass test ;materials ^t^; 

to other students but rather that th^V be instructed t;o a^ange them 

on top of theii; .desk^'^'iji such maftner that- collection is maximally 

* • V; ' • . ^ 

efficient. For example, i*studeix^s migHt be asked to .put their answer- 

* sheets and test hqoklets together w:^th the answer sheets orf top. 

*Fencils -c£n^-lj4M:-fien be.\^ ^leparatelj^^./ By collecting all;of 

the materials himself /hWrse If , the .teacher does not have to recheCk^ 
the materials^ after their collection to fciake certalji that materials 
wer^ received '^fifOm/each student taking the test. ^Aijjy ^temporarily 
missing materials 'should be accounted for before any' students- leave ' 
classroom. , " 



4. Maintaining SeX:urity- pf Test Materials / 
t^j * Test irfaterials should be received by the teacher pn the. ^ay^pf 
testing. ITBS materials should "^e i'^urned ta the School Test 
Coordinator on,the^d§y ITBS. test injg'i-s concluded. The same procedure . 
should '^be followed ,for (JAT testing. .-.Teachers shbal4 make -certain ■ 
,that students do not keep ^test^^teri'als in their .possession except: ?'> ^. 
during the regularly sfhedxiled .testing period. At tn^-teginrting - 
of each testing session, teachers 'should eheck to make cerfekin tfiajts V"* 

' ^ . . ' • - ; ^ : ^ . • 

students- are marking answer sheets corrfectly and that sttJj^nfes' names ^ 

have been •properly recorded. -a . ^i^^ ' ' ' *• • • i 

Upon the collection, of ^test bo6ld:ets and answer sheets, teachers ^iM^ 

should arrange the vjtjboklets in sequence according to code, numbers^ -?-^ ' * \ 

• ' ! ' < ' " ' . ^' ^' ''^'^ 

Such an organization of materials by -the rfceacli§r ^Wiir"faci3;£tate A ♦ ,1- 

*the' check- in, process when these item§"*»^are ret^irne^.. to the School Test \ 

Coordinator from whom they were- rfece^yed^^^'Tle^urn of the appropif^at.e ^^^^^ 

materials wijl be "confirmed ^^hen[ tihe SchoS^ Test Coordinator records " , 



the quantity and c6de numbers of test boq^le^fs^and ; the' QorreofcJi:' !|^^ . \ ^ i*-?^^ 
. quantity of answer' sheets an4 si^ns Form *t#^3 .^^^th^-JSthppl L 
; Coordinator will ^Iso (fellect* Fotms P-2, ,a dailV x'^portf'^ofr'^bsenieef*' ' 
incomplete* tests, and ,a-iimi^g kit^e^tt'Jsiiter each testing * ■ 



session.' . . / ■'^^ 
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Praparingr Students and the Classroom for Testing . - r-. 

1* . Preparatidn p£- Studeujbs • ^ - . 

Teachers shoiild ex^jlain to^studejnts-.as suc^cinctly as. possible 

the' reasons they are bemg tesred and what' uses will be made of the 

results. ^ Evidence suggests "that studeiit? do not respond favorably 

'»:t ' • . ^-^"^ ^ ' - ^ • ^ 

•to l^^gthy,, de tailed, expljtriat ions however accurate they might be* 

'Whatever;*explankti,ojj/is, of fered, _ijt^ be presented a few* days ^ 

prior/to the beginning of testing* * ^i"^® should be allowed, and 

teachers should he prepared to answer students' quest ionsf .about 

the testing in which they will be involved* All third graders will 

be^ administered the Houghton-Mifflin practice* test approximately # 

one week* pripr to the' actual MAAP- testings " these practice tests 

* \' 

will be disfetbuted by the School MAAP, Coordinator . / 

«' • • 

One of the most important factors affecting the students ,^ 
-.. * . ' * • *^ * ' 

psychological readiness for testing is the teacher's .preparedness 

and confidence i^hich is manif est- in the testing situation* If the • 

teacher can be just as much .at ease on the day of testing as he/she 

is, on other days), this will do much'^to ensure reliable and valid* results. 

Being coijQpIet^ely familiar witK the contents of this .Handbook and 

that of the administrator's manual* Will 'do much to help the teacher 

answer questions: and to fgel comfortable and Confident at the time ' 

f- . . ^ ° \ ' . ' . 

or testing* - „ ^ 

•In preparing* students ^^ycho logically to take^ the test, the 

relationship between their effort and the results should' be discussed* 

Too, the signi^jLcance and planned uses of ^the results should be 

explained* /The task here is to establish the proper *iSaychological 

set for taking the test* In'^additiofi to discussing other feature^s 

of the IT^S testing session, "th^ teacher should sa^: ■ , * - 

Iowa Test of Basic Skills.^shows .how much. you know about * 
writing, math, vocabulary, correct En&lish,; and' 
Spelling*, The test also shows your-^^abildty to use charts , ^; . 

ips, ^nd • ref /erence materials Sudh as the dictionary and \ . • 

the encyclopedia * " ; . 



"This claiss. takes the^e tests for some oth6r very important 
reasons* First, ^ the tests will help rae (ifpuv teachers) help. 



■■/• 
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you improve thosre skills which need impifbvirig^ '-Second, these 
tests will show how. the *X third,' fifth, seventh,, ninth) grade(s); 
in our school compare (s) with'- Students in other schopls anci 
in oth^^r states who. af e in the same ^grade . The tests'will - 
not A ba used to show-how you compare with^other students in 
thl'^ class or in this school. Third, .each i.ime you take^ - 
these' tests in later l^rades,^ it will help -yoxi -.tell how- .much /" ^ \' 
. you have 'grown in the'^se skills *since th^ last testing .period A' 

"It is very important that you* do. your best on^these t^sts:' 
'Otherwise, they won't, really show how well yoXi dan do. S'o ^ , • 
make- the tests give a true pi.eture p.f yourself by dbing/the 
best C^at you can on. each one/' • > . ^ / * -o- 

''Does anyone Jiave any questions." . > " . .. - 

Prior to the CAT testing:.*. period, the teacher should" say: 

"The Cognitive Abilities Test shows yqur . ability to do Well in; 
your school work. The, test tells you and youf teacb.er(s)" ,rr;^ 
• 'how well you think J . It "is iinportant to find oiit- how "well" 
you do on problems that are drawn in ;f igures' and diagrams. ^ 
This helps teachets to kndw^more about Ijelping^'yoii 'learn. !^ . 

,^ "There will only be- one^te sting session since t.hiS- test is\ % " 
shorter than the Iowa Test of -Basic Skllls\. ,^Do '*;^diir^best and 
try hard- .to make the test show yout true abilities.' '-iou will .. 
not be compared with your classmates. , We^warit tp' find out* >; 
how students in .this grade compare with students in other -^^choo Is 
in this state^andvin other\states." \/ " . . ' ;/ 
» . *. ' "i--^, ■> * y ' • ' ' - " ' ' % 

* "Does anyone have any quest ions ?vli,/ \ ' ' 

,f •• '. ' ♦ ' • 

The practice test-taking SjSs.sion-for the third grade, students 

will show them how to m'arlc the ans\5rer sheets -and will help "them to ' , 

understand, the effects of . stray ^oro. inappropriate marks.' The .teadher 

might well want to plan in advartce ways of* keeping thei youngest • . . 

children^ task-oriented for extended periods of /time. 01?vipusly, ^ 

tMW'ef forts need to be within the general guidelines, prescribed. 

for administering the specific tests. " 

2. Prep^aration of Classroom for Testing ^ ^ ' ' . / ^ 

It is\;lfe responsibility of the classroom, teacher to.evaluatfe 
*the conditibri^v of the classroom in which the t^st is to be administered 



specific attention should Be directed to the aiiount of 'j?pace between 
the seats, the temperature of the room, the lighting in»" the, room,, and 
noise level in the room* If these- and other conditions .believed".^ 
important are not satisfactory, the teacher shqul'ii contact the School. 
Te^t Coordinator* In this event, the School Coordinator "will have 
to decide If. the conditions can be made satisfactory, or if a satis- 
factory testing site can be arranged, or if the test., will have to be 
rescheduled* , In fairness to -the students, tests slwuld never be 
administered, unless dll conditions are considered satisfactory* 



MAAP CALENDAR FOR CLASSROOM TEACHERS 



Form 
No. 



P-1 



P-2 



P-3 



Report Title 



Report of Orientation and 
^Training Activities ' 



Daily Report of Absentees and 
Incomplete Tests 

Timing Sheet for ITBS i 



Deadline 
for 
Completion 
and /or 
Mailing 



4: 



2 days 
following 
%MAAP 
orientation 
session 

Day* of 
testing 



Day of 
testing 



To . Whom 
Giv^in/.'. 
Sent' 



System' " 
MAAP ^ 

Coordinator 



School 
MAAP, Test 
Coordinator 

.V ' 

School . ^ 
MAAP Test 
Coordinator 



Deadline 

Receipt 

Date 



7 days 

following 

MAAP 

orientation 
session 

Pay of 
•testing 



Turn in with 
rest of 
materials 



Form P-1 ' • - 

REPORT OF ORIENTATION AND" TRAINING ACTIVITIES 

' School System: 

• " 

School r 



Ir_ 5 confirm th^t the following orientation 

^ ^ (Teacher's Name) 

and training activiaties were discussed at the orientation and training session 

held at our school on - ; . 

' . (Date)- y I ^ 

ORIENTATION AND TRAINING ACTIVITIES 



Yes No 

1. Was a rationale presentee for MAAP? 

. Were general policies of ^^AAP discussed? " 

3* Were the reasons^ for maintaining standard conditions 

for testing discussed? ..... * "^'J^ * ^ 

4. Were you given a copy of the MAAP Handbook prior to 

' ^ or at -the orientation-trai^ng session? , ^ _j . 

5. Did you receive a copy of the MAAP test schedule for 

your system? ' 1 / « 

6. Was it explained how ,^ when, .and from whdm you would 

receive test materials? * . . \ ^. . 

7. Was it explained how, when, and to whom test materials 

vould be returned? 

8. Were the conditions under which students should be 

^ -excused" from taking the test explained? . . . . 

9. Were you given sufficient .instruction in how to 

administer the Iowa Test of Bas?,c Skills? . -. ......... ^ 

10. Were you given sufficient instruction in how-to 



administer the Co»gnitive Abilities Test? 

Were you giver 
answer sheet? 



11. Were you given a cdpy of the ITBS manual and 



12. Were you given a copy of the CAT manual and 



answer sheet? . . . . . . ^\ 



-IK 

Form^P-1 (continued) 

ORIENTATION AND TRAINING ACTIVITIES ^ 
i , , 



Yes ^ No 



13. Was there a 'discussion of exactly how you>ishould\ 

time the tests you administer? ^ 

14. . Was it explained that beginnirig and stopping, times »^ 

for each subtest should be recorded on the form 
provided and not on the/ chalkboard? 

.15. t?as it explained how make-up testing should be ' \ 

scheduled and conducted? . . • * . .* . . . 



This form should be compl^e'ted '•immediately 'following the MAAP orientation- 

trafhing sess':||li. It 'should -be given to the ^^teathei; designated by the School 

Coordinator to collect them. ^ 

' ' * . . . " # " , » 

Deadline for mailing' the P-1 FormS to the System MAAP Coordinator: Two 

* 

days following ^the orientation session. ' ' 
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Form P-3 
TIMING SHEET FOR ITBS 





Subtest ' Starting Time 




Working Time » Stopping Time 




Voc'abulary • 


+ 


17 minutes ■ == 




Reading 

Comprehension - 


+ 


r ' . 

. ' ' '/ 
55 minutes* « *> 




Spelling 




* 

12 minutes == 




Capitalization, 


+ 


15 minutes == 




Punctuation 


+ 


20 minutes = _ ' , . 




Language Usage • ' * 


+ 


20- minutes^ = ^ 




Math Concepts 


+ 


" 30 minutes == ' 


\ * 


* 

Matb ^Problem 

Solving • . 


+ 


<• 

30 minutes = 
















This form should be turned 


in to 


the School MAAP Test Coordinator ^ith* 


, % 


the rest of the test materials. 
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' 62. \ ■ 



69. 



